Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding Monitoring Script Option #28

Open
wants to merge 9 commits into
base: main
Choose a base branch
from

Conversation

Layth17
Copy link
Member

@Layth17 Layth17 commented Nov 23, 2022

Steps needed once to reconfigure settings (background info)

  1. Re-run: bash resources.sh init-project --project $GCS_PROJECT --bucket $GCS_BUCKET_NAME --ip-range $IP_RANGE --ms-path <path>/monitor.sh to generate new workflow_options.json & cromwell.conf

  2. New workflow_options.json should contain a new line for the monitoring script

  3. Run: bash start.sh $GCS_INSTANCE_NAME --server-account $GCS_SERVICE_ACCOUNT --project $GCS_PROJECT --boot-disk-size=50GB --boot-disk-type=pd-standard --machine-type=e2-standard-2 to create a VM

  4. Within the VM, check that /shared/cromwell/workflow_options.json reflects the new change

If user provides a path to a monitoring script, every task will generate a monitoring log file

NOTE: if specified, it is the user responsibility to ensure that the monitoring script is in $BUCKET/$MS_PATH, otherwise it breaks

Tasks

  • script works and produces monitoring.log for every task
    |__ - works but breaks estimate-bills script

Tasks beyond the scope of this pull request:

@Layth17 Layth17 linked an issue Nov 23, 2022 that may be closed by this pull request
@Layth17 Layth17 changed the title adding monitor.sh automatically Adding monitoring script option Jan 25, 2023
@Layth17 Layth17 changed the title Adding monitoring script option Adding Monitoring Script Option Jan 25, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Set up resource monitoring for tasks of cromwell runs
1 participant